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A note on Smale’s Global Newton Method 
A. A. Goldstein* 



We have previously considered Smale’s [1] global Newton method in conjunction with 
the Kantorovich inequalities in a simple setting. Our object was to determine a class of 
problems for which the method could be expected to be efficient. We now repeat this 
project using Smale’s [2] estimates at one point instead of the Kantorovich estimate. 



The power of Smale’s estimate stems not only from the fact that the information is con- 
centrated at one point. A further advantage is that, in contrast with the Kantorovich 
inequalities, no estimate of the norm of the inverse of the derivative operator by itself is 
needed. Newton step lengths can be small even if the derivative operator is nearly singular. 

The algorithm below requires only local information for its implementation. To predict its 
behaviour, however, certain global constants are needed. These constants can be estimated 
on a thin cylinder containing a segment joining the origin and the initial value of the vector 
valued function for which we are seeking the root. The iteration count for the algorithm 
is sensitive only to the parameter defined below. 



Theorem 1 (Smale 86 ) Assume F is an analytic map between real Banach spaces X 

and Y. That is, the Frechet derivatives exist for all x G X and k=l,2,3, Given 

xo € X, assume that the inverse of F'(x), which we denote by F'_i(x), exists. Set 



/3{xo) = ||Fij(rco)F(xo)|| and 



If 



7(ro) = : A: > 2| 

^(xohixo) < .130707 



then Xo is an approximate root of F. That is the Newton sequence 



Xk+\ = Xk - F'_i{xk)F{xk) 

is well defined and {x*} converges to say a root of F at the rate; 

\\xk+i - < 2 (^)^ ^(xo) 

* supported by grants NIH RROl 243-05 AND NFS LMC-M4E1 
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Moreover, 



The next result is not given by Smale but it is readily calculated using his ingredients. In 
what follows we shall often abbreviate 0{xk) (and similar expressions) by 

Remark 2 

||F'(a:,)|| < 1.85||F'(a:o)|| /:=1,2,3, 

Proof. In [ 2 ], Proposition 2 , we find the formula 

<>*,■+1 ^ — 4 a ^. + 1 ), 

where Qjt = /3k 'yk ^ 1/8- Then < (2 Ok)^- In Smale’s proof of Lemma 2 we 

find II / - II < (1 - Qk)~'^ ~ 1- Whence || / - ) || < 

1 + (ll/4)afc. Let Hk = F!_i(xk)F'{xk+\) then F' {x k+i) = F'{xk) Hk, s^nd 



k 

l|e'(ii+,)|| < imio)lin(l + (ll/4)(2a„f) 

1=0 



We can improve this result by using sharper bounds for i=0 and for i=l, namely, .30G 
and .138, respectively. Then 



log 



n(i + (ii/4)(2Q„f ) 



< (11/4) 




< .172 



Finally we have the estimate 

OO 

nii^^-ii < 1-85. 

1=0 



Assume the hypotheses of Theorem 1 . Let 



T = e A' : ||F(x)|| < IIF(xo)ll). 



We assume that 7 (x), F{x) and /3{x) are defined and can be calculated throughout T. 
Assume the existence of numbers /?, 7 , K and a that bound /3{x), 7(^)1 ||-P’^(^)|| nnd 



a(.r) = ||r ,(o:) 



Fjx) 



3 



on T. Let ]x[ denote the smallest integer > x. 



Algorithm 3 Given Xi G T, we define as follows. Set t, = 1 — (87,/?i)“\ where 
7, = 7(x,) and /?i is defined similarly. Set (q = x, and run the Newton sequence for G 
starting at Let k be the smallest integer satisfying 

G{a) < l|F(rr,)||/407./?, 



Set Xi+i = 



The algorithm can be run and terminated with a posteriori data, without any knowledge 
of the values of the constants 7, <7, and K. Moreover to verify a) and b) below we do 
not use these constants. However the global behaviour of the algorithm as described in c) 
and d) is given in terms of these constants. Let A',- = 1.85 ||A'(x,)||. 



Claim 4 



(a) x,+i can be found in S' = ] log2 (log2 (80 K, ji / ||A'(x,)||))[ steps. 

(b) l|f(^.+.)ll < (1-(1/107A))I|F(^,-)II 

(c) Let S = log2(log2(S0 A' 7 cr)). Given e > 0 , if k > ]10 7;5S log2(l/e)[ 
then (||A(x/t)/l|A(xo)) < e. 

(d) If k > ]10 7/?Slog(8 7cr)[ then xjt is an approximate root of F. 



Proof. We show first that x^-i-i can be chosen as claimed. Let G'(x) = t,F(xi). Then 
Xi is an approximate root for G'. Hence if ^0 = 2;, and ^k+i = — F'{^k)G{^k) then 

converges to a root of G'. We now prove (b) 

We have that G'{xi) — G'(C) = <S‘(x,) = (F{xi) / 8 = F(x,) — A(^,). Also, 
F{xi) - F{xi+,) = F{xi)-F{^ + G'{C)-G\xi+^) = (A(x,)/8A-7.) + G\V) ~ 
G\xi+i). Thus b) is true. 

We now prove a) by counting the steps needed to ensure that 
||G'(G)|| < ||A(x .)||/40 7.A = tmp. Since G*(G) = (6+1 - e.) 

we may choose k to ensure that 2 fd{xi) < tmp 

To prove c) replace and 7, by (3 and 7, respectively. If k satisfies 
7 log2(l -(I/IO7/?)) < e then (|| A(x)t)|| / ||F(xo)l|) < e. 

To go from k to k+1 requires no more than S steps. 
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We now turn to d). If ||F(x)|| < then x is an approximate root for F. Thus we 

replace 1 / 6 in c) by 8 



Remarks 5 

The method is sensitive only to the number 7 /? ! 

Note that from the above proof F(0 = Since lies nem' (^* the global 

constants need be estimated only on a slender tube surrounding the segment joining the 
origin and F'(a:o). 
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